Skip to content

[Feature][RayJob] Remove wget dependency in Sidecar GCS wait#4468

Open
400Ping wants to merge 12 commits intoray-project:masterfrom
400Ping:feature/remove-wget
Open

[Feature][RayJob] Remove wget dependency in Sidecar GCS wait#4468
400Ping wants to merge 12 commits intoray-project:masterfrom
400Ping:feature/remove-wget

Conversation

@400Ping
Copy link
Contributor

@400Ping 400Ping commented Jan 30, 2026

Why are these changes needed?

RayJob Sidecar mode waits for Ray Dashboard GCS health before submitting jobs.
That wait loop previously depended on wget.

Some Ray images may not include wget, which can cause Sidecar submission startup failures before job submission begins.
Since this check targets api/gcs_healthz (available across Ray versions used here) and Sidecar submitter already depends on Python (ray CLI), we can remove the wget dependency by using Python urllib directly.

Change summary

  • RayJob Sidecar mode

    • Replace GCS wait-loop health command from wget to Python urllib.
    • Remove version-based branching for this Sidecar GCS health check path.
    • Keep the same endpoint and wait-loop behavior (until ... sleep 2 ...).
  • Tests

    • Update Sidecar command expectation to Python health command.
    • Add/adjust version-switch tests to verify the Sidecar health command remains Python for:
      • 2.53.0
      • 2.52.1
      • invalid version string

Out of scope

  • RayService readiness/liveness model changes
  • RayCluster probe behavior changes

Related issue number

Closes #3837

Checks

  • I've made sure the tests are passing.
  • Testing Strategy
    • Unit tests
    • Manual tests
    • This PR is not tested :(

Signed-off-by: 400Ping <jiekaichang@apache.org>
Signed-off-by: 400Ping <jiekaichang@apache.org>
Signed-off-by: 400Ping <jiekaichang@apache.org>
Signed-off-by: 400Ping <jiekaichang@apache.org>
@400Ping 400Ping marked this pull request as ready for review February 4, 2026 14:30
Copy link
Member

@win5923 win5923 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we need change to urllib.request for Ray < 2.53.0?
Since the slim images (without wget) are only being released for Ray 2.53+, I think older versions can keep using wget.

Signed-off-by: 400Ping <jiekaichang@apache.org>
Copilot AI mentioned this pull request Feb 5, 2026
4 tasks
Signed-off-by: 400Ping <jiekaichang@apache.org>
Signed-off-by: 400Ping <jiekaichang@apache.org>
Signed-off-by: 400Ping <jiekaichang@apache.org>
Copy link
Member

@win5923 win5923 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could you also add unit tests for this, and update the title and description?

…switch tests

Signed-off-by: 400Ping <jiekaichang@apache.org>
@400Ping
Copy link
Contributor Author

400Ping commented Feb 13, 2026

Could you also add unit tests for this, and update the title and description?

Done

@400Ping 400Ping requested a review from win5923 February 13, 2026 15:27
Copy link
Member

@win5923 win5923 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Wait a minute, we actually don’t need to care about which Ray image version is being used. Since we are checking RayDashboardGCSHealthPath, this endpoint exists both before and after 2.53.0 version. We can therefore simplify this by replacing wget with Python’s urllib.

@400Ping 400Ping changed the title [Feature] Get rid of wget dependency [Feature][RayJob] Remove wget dependency in Sidecar GCS wait for Ray >= 2.53 Feb 13, 2026
Signed-off-by: 400Ping <jiekaichang@apache.org>
Copy link

@cursor cursor bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes and found 2 potential issues.

Signed-off-by: 400Ping <jiekaichang@apache.org>
@400Ping 400Ping changed the title [Feature][RayJob] Remove wget dependency in Sidecar GCS wait for Ray >= 2.53 [Feature][RayJob] Remove wget dependency in Sidecar GCS wait Feb 13, 2026
@400Ping 400Ping requested a review from win5923 February 14, 2026 00:51
@400Ping
Copy link
Contributor Author

400Ping commented Feb 22, 2026

cc @JiangJiaWei1103 @yuhuan130 to take a look

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Get rid of wget dependency

2 participants